Publishing a Dataset for Compute-to-Data
A data provider can publish a dataset with compute access type when the collection of data cannot be downloaded as-is. This type of data needs to be computed with a trusted algorithm job to produce a distributable output file.
To publish a dataset for compute-to-data purposes:
- Log in to the marketplace.
- From the left navigation bar, go to Create > Dataset.
Step 1: Connect Your Asset
-
Set your access type as 'Compute'.
-
Select 'Disable' for the Aggregate Only setting.
-
Select the Edge Node that will connect to the data source.
-
Paste the Source URL of the dataset.
-
Optional: Add key-value pairs of HTTP headers in your API by clicking 'Add HTTP Headers'.
-
Optional: Create parameters for your API to allow for more specific data to be fetched from your dataset by clicking 'Add Parameters'.
To indicate these parameters, fill in the following fields:
- Display Name: The simplified name of the actual parameter key for, easy understanding by consumers of your dataset.
- Parameter Key: Actual name of the parameter of your dataset.
- Parameter Type: The type of parameter input for data consumers (string/int/boolean/options).
- You may also click on 'Expand' to include a short description of your given parameters.
Step 2: Basic Information
- If your data asset does NOT contain real data, select 'Experimental'. Otherwise, select 'Production'.
- Name your data asset by providing a concise Dataset Title that will capture the initial attention of potential data consumers.
- Categorize your data asset according to the closest industry Category.
- Provide an Overview of your asset as a summary.
- Provide Additional Details, or any additional information that you think will be helpful to potential data consumers, e.g., data attributes, purpose, etc.
- Select the Compatible Algorithm(s) to run with your dataset. You may also choose to skip during publish and add it at a later point. Note that data consumers will not be able to purchase your dataset unless a compatible algorithm has been configured.
- Select the Validity Period – how long your data asset should be available to the data buyer after purchase.
Step 3: Further Details
- Indicate the Asset Permissions - whether to initially 'Allow All Users' or 'Deny All Users' from consuming your data asset.
- Optional: Tag your assets with related keywords to make them searchable to a wider audience.
- Optional: Upload or link a Sample File that can be downloaded by data consumers before purchasing your actual data.
- Optional: Upload a Sample Image file or screenshot of your asset.
- Optional: Link your End User License Agreement to specify any terms and conditions for the use of your data asset.
Step 4: Pricing
- Select the pricing type: 'Free', or 'Post-pay'. You will not be able to switch between the pricing types after you have published the asset; however, you can still adjust the actual price if 'Post-pay' pricing is selected.
- For Free Pricing, simply click 'Next' to proceed to the next steps. For Post-pay payment, select whether the charging mechanism is 'Set price' or 'Pay-per-byte' and indicate the value.
Step 5: Review and Publish
- Review all information. If any updates are needed, click 'Edit' to return to the previous pages or click the 'Go Back' button.
- Once finalized, click 'Publish Asset'.